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We identify and discuss the ground state of a quantum magnet on a triangular lattice with bond- 
dependent Ising-type spin couplings, that is, a triangular analog of the Kitaev honeycomb model. 

The classical ground-state manifold of the model is spanned by decoupled Ising-type chains, and its 
accidental degeneracy is due to the frustrated nature of the anisotropic spin couplings. We show 
how this subextensive degeneracy is lifted by a quantum order-by-disorder mechanism and study 
the quantum selection of the ground state by treating short-wavelength fluctuations within the 
linked cluster expansion and by using the complementary spin-wave theory. We find that quantum 
fluctuations couple next-nearest-neighbor chains through an emergent four-spin interaction, while 
nearest-neighbor chains remain decoupled. The remaining discrete degeneracy of the ground state 
is shown to be protected by a hidden symmetry of the model. 

PACS numbers: 75.10.Jm, 75.30.Ds, 75.30.Et 


Frustrated magnets, systems in which every pairwise 
exchange interaction cannot be simultaneously satisfied, 
are characterized by accidental degeneracies between var¬ 
ious order patterns 1 . Often, these accidental degen¬ 
eracies are lifted via an order-by-disorder mechanism, 
driven by thermal and/or quantum fluctuations, select¬ 
ing an unique ground state 2-4 . In highly frustrated quan¬ 
tum magnets, those with extensive degeneracy, e.g., the 
isotropic spin one-lralf kagome and pyrochlore antiferro- 
magnets (AF), the order-by-disorder mechanism is inac¬ 
tive and they remain disordered down to the lowest tem¬ 
peratures, realizing so-called quantum spin liquids (QSL) 
in their ground states 1 . 

In Mott insulators, with unquenched orbital moments 
and strong spin-orbit coupling, bond-dependent Ising- 
type interactions may dominate over the conventional 
Heisenberg term 5- '. In turn, such Ising-type couplings, 
even being ferromagnetic (FM), can frustrate a long- 
range magnetic order and stabilize a QSL state 8 . The 
most celebrated model realizing the above scenario is 
the exactly solvable Kitaev honeycomb model 9 . In this 
model, nearest-neighbor (NN) spins are coupled by Ising- 
type terms and the three non-equivalent bonds of the 
honeycomb lattice host different components of the spin 
one-half operators. Its ground state is a QSL with frac¬ 
tionalized fermionic excitations 9 . 

Following a theoretical proposal' for a possible re¬ 
alization of the Kitaev honeycomb model in iridates 
A 2 lrC >3 (A = Na, Li), various extensions of the model 
have been studied in connection to experiments 10-16 
on actual materials. These model extensions include 
terms like: the isotropic Heisenberg exchange (the 
so-called Kitaev-Heisenberg (KH) model) 17-21 , further- 
neighbor couplings 21-23 , and additional symmetry- 
allowed anisotropies 24-28 . The resulting theoretical phase 


diagrams are characterized by various ordered phases (in¬ 
cluding those seen experimentally) and by a finite stabil¬ 
ity window for QSL around the Kitaev limit. 

Recently, a triangular analog of the KH model 29 for 
classical 30 and quantum 31,32 spins has been studied nu¬ 
merically. The obtained rich phase diagram includes a 
Z 2 -vortex crystal phase near the AF Heisenberg limit, 
and a nematic phase of decoupled Ising chains with sub- 
extensive degeneracy at the Kitaev limit 30,31 . In addi¬ 
tion, a chiral spin-liquid phase has been proposed close 
to the antiferromagnetic Kitaev limit 32 . 

Here, we study analytically the Kitaev model on the 
triangular lattice and solve the puzzle of its ground state 
by analyzing the effects of quantum fluctuations within 
both the linked-cluster expansion , 33 combined with de¬ 
generate perturbation theory, and the linear spin-wave 
theory. We show that such a deceptively simple model, 
once realized on a triangular lattice, becomes the host 
of very interesting and unexpected order-by-disorder ef¬ 
fects such as: the quantum selection of the easy axes, 
the emergence of a specific four-spin interaction, the re¬ 
duction of the sub-extensive degeneracy of the nematic 
ground state manifold down to a discrete one protected 
by a hidden symmetry of the model. 


I. THE MODEL 

We consider a triangular lattice lying in the (1,1,1) 
plane of the spin-quantization frame [see Fig. 1(a)] and 
label by ( 7 ) (= x, y , z) its three non-equivalent NN bonds 
spanned by the lattice vectors a x = (V 2 , — vAi/ 2 ), a y = 
(i/ 2 , v/ 3 / 2 ) and a z = (1,0), respectively. On a ( 7 )-bond, 
the one perpendicular to the 7 spin-quantization axis, 
only the S? components of the spin one-half operators 
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Figure 1. (color online), (a) Ising-type spin couplings on 
the three non-equivalent bonds of the triangular lattice of 
model (1). The lattice lies in the (1,1, 1) plane of the spin- 
quantization axes. On a ( 7 )-bond, the one perpendicular to 
the 7 (= x, y, z) spin quantization axis, only the 7 -components 
of neighboring spins are coupled, (b) Four-sublattice struc¬ 
ture of the triangular lattice used for the unitary transfor¬ 
mations discussed in the text, (c) Sketch of the 4 th order 
perturbation process leading to the coupling, via quantum 
fluctuations, of the four spins siting around a diamond [see 
Eq. (3)]. In the virtual states, the location of the misaligned 
spins (spin-flips are performed in pairs at one of the 4 bonds of 
the diamond at each step: top-left => bottom-right =>■ bottom- 
left =>■ top-right) are shown by filled circles and the wavy lines 
mark the broken (z)-bonds. 

Si are coupled by a Ising-type interaction [see Fig. 1(a)], 
and the corresponding Hamiltonian takes the following 
form 

H = -J2 K ^S7 +a ^. ( 1 ) 

i,7 

In model (1), the signs of the A 7 couplings can be indi¬ 
vidually flipped by means of a canonical transformation. 
For instance, to flip the sign of K z independently from 
the signs of the other two couplings, K x and K y , one 
needs to perform spin rotations around the y axis by an 
angle 180° on sites belonging to the sublattices B and C 
[see Fig. 1(b)], i.e., [(Sf.Sj'.Sf) -+ ( -S?,S*,-S?) for 
i € B ® C], The signs of I\ x (K v ) can be flipped inde¬ 
pendently in the very same way by performing 180° spin 
rotations around z ( x ) axis on the sublattices B and D (A 
and B). In what follows, without any loss of generality, 
we consider all K 1 to be positive (FM couplings). 

II. GROUND STATE MANIFOLD 

In the isotropic FM case K 1 = K > 0, the classical 
ground-state energy is simply proportional to M 2 where 
M = (Si). This accidental symmetry implies that the 


ordered moment M can be freely rotated, i.e., no pre¬ 
ferred axis exists. Moreover, the coupling between NN 
chains, along any of the three lattice directions (e.g., 
spanning along (z)-bonds), does not involve the corre¬ 
sponding projections of the spins (e.g., S '(). Therefore, 
these latter projections of the spins can be freely flipped 
along any of those chains individually 30,31 . This leads 
to an additional 2 L -fold degeneracy, where L is the lin¬ 
ear size of the system. In the anisotropic case, when the 
couplings K 1 are different from one another, the easy 
axis is dictated by the strongest coupling (e.g., z axis for 
\K Z \ > | K x \, \K y \). However, the ground-state manifold 
still has a sub-extensive degeneracy as it is character¬ 
ized by completely decoupled either FM (for I\ z > 0) or 
AF (for K z < 0) chains along (^)-bonds. Such a sub- 
extensive degeneracy is inherent to models with Ising- or 
compass-type bond-dependent anisotropies 8 . 

In principle, these accidental classical degeneracies, not 
being related to apparent symmetries, can be lifted by 
quantum fluctuations. We would need to calculate the 
energy corrections due to zero-point quantum fluctua¬ 
tions (e.g., within the spin-wave theory) for each de¬ 
generate classical ground state and single out a ground 
state for which the corrected energy is minimized. For 
an infinitely degenerate manifold this is obviously not 
feasible and we need to resort to some other procedure. 
The linked-cluster expansion, 33 combined with degener¬ 
ate perturbation theory, allows to compute quantum cor¬ 
rections to a ground-state energy from short-wavelength 
quantum fluctuations and to identify the mechanism for 
quantum selection of the ground state. 34-39 


III. QUANTUM SELECTION OF THE GROUND 
STATE 

A. Easy axes 

In the isotropic case A' 7 = 1, we consider a FM state 
with the ordered moment M pointing in a generic direc¬ 
tion identified by the unit vector m = (rn x . rn y , m z ) = 
(sin 9 cos <j), sin 9 sin <fi, cos 9). Then, we rotate the spin- 
quantization frame xyz of the Hamiltonian (1) to a new 
frame x'y'z' in which m || z'. The transformed Hamil¬ 
tonian on NN ij bond includes various terms in the new 
spin-quantization frame: the Sf Si- terms represent the 
unperturbed (mean-field) Hamiltonian and the remain¬ 
ing ones, those creating misaligned spins at the cost of a 
mean-field energy, are treated as perturbations. At the 
second order in the perturbation expansion, the terms 
creating only one spin-flip, e.g., Sf Si- , give energy cor¬ 
rections that sum up to zero. Only the terms inducing 
two spin-flips on a given (qj-bond give a cumulative finite 
energy correction depending on the direction of m. The 
creation/annihilation amplitude for two misaligned spins 
on a (qj-bond is T 7 = (l — to 2 ) /4 with a correspond¬ 
ing energy cost A 7 = (2 — to 2 ). This gives the following 
quantum energy correction per site: 
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Figure 2. Color map of the second-order quantum energy 
correction (2) for an arbitrary direction m of the ordered mo¬ 
ment. The minimum energy is achieved for m pointing along 
one of the spin-quantization axes. 


In Fig. 2, we report the second-order quantum energy 
correction (2) for an arbitrary direction m of the or¬ 
dered moment via a color map. Each point on the sphere 
stands for a specific direction of m within the original 
spin-quantization frame xyz and the color scale gives the 
corresponding value of (2). It is evident that the mini¬ 
mum of the energy is realized when m points along one 
of the spin-quantization axes implying that they are se¬ 
lected by quantum corrections as the easy axes. This can 
be also seen from the result of a naive expansion, the last 
term in Eq. (2), explicitly showing how a fourth-order cu¬ 
bic anisotropy emerges from quantum fluctuations. 

The above result explains and quantifies the order-by¬ 
disorder selection of the easy axes numerically found in 
Refs. 30 and 31 by means of classical Monte Carlo and 
of density matrix renormalization group (DMRG) meth¬ 
ods, respectively, and also agrees with previous studies 
performed on models similar to (1), but realized on other 
lattices 17,40-42 . This study is complementary to the spin- 
wave analysis performed in Ref. 31 around the Heisenberg 
limit of the FM KH model on a triangular lattice. In that 
case, a finite Kitaev coupling leads to the selection of easy 
axes and breaks the accidental O (3) symmetry down to 
Zg. In the present case, the degenracy of the ground 
state remains sub-extensive at 3 x 2 L . 


B. Coupling between chains 

Both in the isotropic case K 1 = K (choosing 2 as 
easy axis) and in the anisotropic case \K Z \ > \K X \, \K y \, 
the ground-state manifold is spanned by decoupled ei¬ 
ther FM (for K z > 0) or AF (for K z < 0) chains along 
(z)-bonds. We now compute, within the linked-cluster 
expansion 33 , the quantum corrections induced by the 
K x and K y terms, and find the related effective cou¬ 
plings between chains. The expansion parameter scales 


as K x ( v ' > /t,K z (z = 3 being the number of NNs), and the 
results we derive are valid in the isotropic case /\ 7 = K 
too. The K x and K y terms generate fluctuations out of 
the classical ground state by creating/annihilating pairs 
of misaligned spins on the corresponding bonds. Ac¬ 
cordingly, the linked graphs relevant to the perturba¬ 
tion expansion are those composed by ( x )- and/or ( y )- 
bonds. Open linked graphs composed of n bonds con¬ 
tribute to the (2 n) th leading order, while closed linked 
graphs composed of n bonds contribute to the n th lead¬ 
ing order. Given the obvious absence of ( 2 )-bonds in 
the perturbation expansion, there is no loop-like cluster 
composed of an odd number of bonds and hence no per¬ 
turbative ocld-order correction exist. In the 2 nd order, 
there is no coupling between chains but a reduction of 

the ground state energy by —^ \ k z \ v ■ or ~ 

der, straight 3-site clusters, composed of two ( x )- or two 
(y)- bonds, give just a reduction of the ground state en¬ 
ergy by ~ 2 M 8 ^ Kx \ k $ an d a S a i n do not couple chains. 
The other two types of 3-site clusters, composed of (x)- 
and (y)- bonds, with 7r/3 or 27r/3 angles in between, give 
no contribution at all because the 'K {x ' > and bond 
Hamiltonians with a common vertex anticommute and 
they always come in permuted pairs. The 4 th order cor¬ 
rection coming from a diamond -shape 4-site cluster [see 
Fig. 1(c)] give instead a coupling between pairs of spins 
belonging to next-nearest-neighbor (NNN) chains in the 
following form 
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where the sites i + a^, and i + a y belong to NNN chains, 
and they are the ends of the longer diagonal of the di¬ 
amond cluster [see Fig. 1(c)]. It is worth noting that 
SiS? +a is just j for K z > 0 and for K z < 0 leading 
to a coupling between NNN chains of the same sign of the 
one acting along the chains. This does not fully lift the 
degeneracy as, at this order, the two sublattices formed 
by NN chains remain decoupled. The degeneracy is four¬ 
fold (3 times four-fold for K x = K y = K z ). Actually, 
we found that this degeneracy is dictated by a hidden 
symmetry of the model. This hidden symmetry is un¬ 
covered by a four-sublattice unitary transformation from 
Ref. 5. This transformation leaves the Hamiltonian (1) 
unchanged, but flips the sign of the z components of the 
spins on only one of the two sublattices. We divide the 
triangular lattice in 4 sublattices, as shown in Fig. 1(b), 
and perform the following local spin-rotations: by 180° 
on sublattices B, C, and D around z, y, and x axes, re¬ 
spectively, while keeping the spins on the A sublattice in 
the original frame. This transformation leaves the Hamil¬ 
tonian (1) unchanged. On the other hand, the net effect 
on a state with spins ordered along the 2 direction is to 
flip the sign of the 2 component of every second chain, 
the chains belonging to the C © D sublattice, showing 
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that NN chains are completely decoupled as any relative 
order between them leads to the same energy. 


C. Comparison to numerics 

Very recently, Becker et. al , 31 used the DMRG method 
to compute the ground state and the first excited states 
of the Kitaev Hamiltonian (1) in the AF isotropic case 
(K-y = K < 0) on finite clusters with open boundary 
conditions. The considered clusters are strips of 3 and 
4 chains of length L < 14, cut out from a triangular 
lattice (see Figs. 12 and 13 in Ref. 31). The spatial 
anisotropy of such clusters breaks the original symme¬ 
try of the triangular lattice and forces the spins to order 
AF along the longer direction (e.g., along the (z)-bonds) 
and, correspondingly, in the like spin component ( S z ). 
Measuring the spin correlation functions across the sys¬ 
tem, they found AF correlations between the NNN chains 
and no correlations between NN ones, in agreement with 
our analysis. Moreover, for the largest analyzed system, 
the numerically found gap to the first excited state, fea¬ 
turing FM correlations between NNN chains, amounts 
to 0.0055 |A'| per diamond , which is again in very good 
agreement with the value 1/192 |A'| ~ 0.0052 \K\ pre¬ 
dicted by Eq. (3). 



Figure 3. Color map of the spin-wave excitation spectrum of 
model (1) in (a) the FM state Eq. (4) and (b) the stripy AF 
state Eq. (5), for A 7 = 1 . Only one of the lower branches is 
shown in (b). Hexagons mark the crystallographic Brillouin 
zone. The right panels report the corresponding magnetic 
structures. 


IV. SPIN-WAVE THEORY 

We now apply the linear spin-wave theory to the 
Hamiltonian (1). In order to compare the results ob¬ 
tained by the linear spin-wave theory with those obtained 
by the linked-cluster expansion, we will focus on the case 
K z > K x ,K y > 0 and consider two states that are de¬ 
generate in the classical limit. These are the FM and 
stripy AF states [shown as right panels in Fig. 3] with 
spin ordering along the z axis. Within spin-wave theory 
we find one branch in the FM state 

w 2 (q) = (K z - K x c x ) (K z - K y cy) , (4) 

and four branches in the stripy AF state 

<4 ,2 (q) = Kl ± \J K z {Kiel + Kffi) - KlKlclsl , 

( 5 ) 

where c x = cos q • & x , c y = cos q • a y , s x = sin q ■ a. x 
and s y = sinq • a y . The other two branches, 0 * 3,4 (q), 
are obtained from 0 * 1,2 (q) by the exchanges c x <-> c y and 
s x s y . 

Fig. 3 shows the color map of the obtained spin-wave 
excitation spectra for A " 7 = 1 in both the FM state and 
the stripy AF state. In this latter case, only one of the 
two degenerate lower branches is reported. The corre¬ 
sponding magnetic structures are sketched on the right. 
In both cases, the excitation spectra are well defined over 
the entire Brillouin zone, confirming that the FM and 


the stripy AF states do indeed minimise the classical en¬ 
ergy. Moreover, the lines of nodes, related to the sub- 
extensive degeneracy of the classical manifold discussed 
above, are clearly visible. Comparing the zero-point spin- 
wave energies obtained from Eqs. (4) and (5), we find 
that the FM state is always favored against the stripy 
AF state, in agreement with the linked-cluster expansion 
result. Moreover, by expanding the spin-wave excita¬ 
tion spectra in Eqs. 4 and 5 in terms of small K x , y /K z , 
we find analytically the difference between the zero-point 
energies of the FM and the stripy AFM states to be 

8EsJ = — | x ygg J/j v , which is in agreement with the 

prediction of Eq. (3) except for a multiplicative factor |, 
whose presence can be anyway readily explained. The 
linear spin-wave theory does not take into account the 
interactions between misaligned spins. Therefore, in the 
virtual state shown as the middle diamond in Fig. 1(c), 
8 broken (^)-bonds are counted in the linear spin-wave 
theory instead of the actual 6 broken ( 2 *)-bonds shown in 
Fig. 1(c). 

In conclusion, we have discussed quantum order-by¬ 
disorder in the Kitaev model on the triangular lattice 
within the linked-cluster expansion and the complemen¬ 
tary spin-wave theory, and clarified the true nature of the 
ground state of this frustrated quantum spin model. In 
particular, we have shown (i) the presence of a mecha¬ 
nism of quantum selection of easy axes, (ii) the emergence 
of a four-spin interaction that reduces the sub-extensive 
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degeneracy of the ground state manifold (3 x 2 L ) down 
to a discrete one (3 x 2 2 ), and (iii) the existence of a 
hidden symmetry of the model that protects this latter 
degeneracy. The present analytical study explains and 
quantifies the results of numerical simulations 31 . The 
developed scheme, that makes explicit links between de¬ 
generate perturbation theory and spin-wave analysis, can 


be applied to other quantum spin models in which spin 
frustration is driven by anisotropic spin couplings. 
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